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Abstract. This paper considers the portfolio management problem for an investor with finite 
time horizon who is allowed to consume and take out life insurance. Natural assumptions, 
such as different discount rates for consumption and life insurance lead to time inconsistency. 
This situation can also arise when the investor is in fact a group, the members of which have 
different utilities and/or different discount rates. As a consequence, the optimal strategies are 
not implementable. We focus on hyperbolic discounting, which has received much attention 
lately, especially in the area of behavioural finance. Following [10], we consider the resulting 
problem as a leader-follower game between successive selves, each of whom can commit for an 
infinitesimally small amount of time. We then define policies as subgame perfect equilibrium 
strategies. Policies are characterized by an integral equation which is shown to have a solution in 
the case of CRRA utilities. Our results can be extended for more general preferences as long as 
the equations admit solutions. Numerical simulations reveal that for the Merton problem with 
hyperbolic discounting, the consumption increases up to a certain time, after which it decreases; 
this pattern does not occur in the case of exponential discounting, and is therefore known in 
the litterature as the "consumption puzzle" . Other numerical experiments explore the effect of 
time varying aggregation rate on the insurance premium. 
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a thorough reading of the first version. 
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1 Introduction 

The investment /consumption problem in a stochastic context was considered by Merton [23] 
and [21]. His model consists in a risk- free asset with constant rate of return and one or more 
stocks, the prices of which are driven by geometric Brownian motion. The horizon T is pre- 
scribed, the portfolio is self-financing, and the investor seeks to maximize the expected utility of 
intertemporal consumption plus the final wealth. Merton provided a closed form solution when 
the utilities are of constant relative risk aversion (CRRA) or constant absolute risk aversion 
(CARA) type. It turns out that for (CRRA) utilities the fraction of wealth invested in the risky 
asset is constant through time. Moreover for the case of (CARA) utilities, they are linear in 
wealth. 

Richard [30] added life insurance to the investor's portfolio, assuming an arbitrary but known 
distribution of death time. In the same vein Pliska [28] studied optimal life insurance and 
consumption for an income earner whose lifetime is random and unbounded. More recently 
Kwak et al.[18] looked at the problem of finding optimal investment and consumption for a 
family whose parents receive deterministic labor income until some deterministic time horizon. 

The aim of this paper is to revisit these problems in the case when the psychological discount 
rate is not constant. By now there is substantial evidence that people discount the future at a 
non-constant rate. More precisely, there is experimental evidence (see Frederick et. al. [TT] for 
a review) that people are more sensitive to a given time delay if it occurs earlier: for instance, 
a person might prefer to get two oranges in 21 days than one orange in 20 days, but also prefer 
to get one orange right now than two oranges tomorrow. This is known as the common 
difference effect, and would not occur if future utilities are discounted at a constant rate. 
Individual behaviour is best described by hyperbolic discounting, where the discount factor 
is h(t) = (1 + at)~a, with a, b > 0. The corresponding discount rate is r (t) = y^j, which starts 
from r (0) = ^ and decreases to zero. Because of its empirical support, hyperbolic discounting 
has received a lot of attention in the areas of: microeconomics, macroeconomics and behavioural 
finance. We just mention here among others the works of Loewenstein and Prelec [21J, Laibson 
[20] and Barro [2]. 

It is well-known that, for non-constant discount rates, optimal strategies are time inconsis- 
tent: for t\ < t2, the planner at time t\ will find a strategy f\ to be optimal on [t±, oo), while the 
planner at time t2 will find a different strategy /2 to be optimal on that interval. As a result, the 
planner at time will not implement the strategy devised by the planner at time t\ , unless there 
exists some commitment mechanism. If there is none, then the strategy fi, which is optimal 
from the perspective of the planner at time t±, is not implementable, and the planner at time t\ 
must look for a second-best strategy. This situation was first analyzed by Strotz [31], and this 
line of research has been pursued by many others (see Pollak [29J, Phelps [27], Peleg and Yaari 
[26j . Goldmann [12], Laibson [20] , Barro [2], Krusell and Smith [19]), mostly in the framework 
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of planning a discrete-time economy with production (Ramsey's problem). It is by now well 
established that time-consistent strategies are Stackelberg equilibria of a leader-follower game 
among successive selves (today's self has divergent interests from tomorrow's). More recently, 
the problem has been taken up again by Karp [T3], [T2], [15j . [16| . Luttmer and Mariotti, |22j . 
Ekeland and Lazrak [7J, [8], [9], always within the framework of planning economic growth. In a 
series of papers Bjdrk and Murgoci [3], Bjork, Murgoci and Zhou [4] look at the mean variance 
problem which is also time inconsistent. 

Ekeland and Pirvu [10] seem to have been the first to have considered the Merton problem 
with non-constant psychological discount rates. They studied the case of an investor who has a 
CRRA utility u (c) = -±c p , p < 1, and a quasi-exponential discount factor h(t), that is, h (t) 
must belong to one of the families: 



Extending the basic idea of Ekeland and Lazrak [7] to the stochastic framework, they find 
time-consistent strategies in the limiting case when the investor can commit only during an 
infinitesimal time interval. They show that time-consistent strategies exist if a certain BSDE 
has a solution, and they show that, because of the special form of the discount factor, this BSDE 
reduces to a system of two ODEs which has a solution. 

The aim of this paper is to extend these results to more general discount rates, and more 
general problems. Quasi-exponential discount rates, although mathematically convenient, are 
not realistic. As we saw earlier, empirically observed discount rates among individuals tend to 
be hyperbolic. But there is another, perhaps more compelling, reason why general discount rates 
are of interest. Standard portfolio theory assumes that the investor is an individual. However, 
in most situations investment decisions are made by a group, such as the management team 
in the case when the investor entrusts his portfolio to professionals. Even when the investor 
manages the portfolio directly, the word " investor" which is suggestive of a single decision-maker 
very often hides a different reality, namely the family: one would expect the husband and the 
wife to take part in investment decisions concerning the couple. By now, the relevant economic 
literature has made abundantly clear (see Chiappori and Ekeland, [5]) that the group cannot be 
represented by a single utility function. Instead, there should be one utility function, and one 
discount factor per member of the group. The actual decision taken is the result of negociations 
within the group, a kind of black box which cannot be opened by outsiders. However, if the group 
is efficient, that is, if the outcome is Pareto optimal, then it can be modelled by maximising a 
suitable convex combination of the members' utilities, the weight conferred to each individual 
representing his/her power within the group. In the (very) particular case when all members 
of the group have the same utility, but different discount rates, the group behaves as a single 
individual with non-constant discount rate. 

The difficulty in dealing with non-constant discount rates is to define time-consistent strate- 
gies and to prove that they exist. We follow the approach pionneered by Ekeland and Lazrak 
[7J in the deterministic framework, by considering the limiting case when the decision-maker 
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can commit only during an infinitesimal amount of time. This approach was already followed 
in our earlier work [TO], in the case of quasi-exponential discount factors. The proofs in that 
paper do not readily extend to the case of general discount factors, so in the present work we 
present a different method. Whereas [TO] characterizes the time-consistent stategies in terms 
of a certain BSDE, we now characterize them in terms of a certain "value function", which 
is shown to satisfy a certain integral equation which has a natural interpretation. Assuming 
utilities to be (CRRA), we decouple time and space, and reduce it to a one-dimensional integral 
equation, which we solve by a fixed-point argument. Moreover this one dimensional equation 
is amenable to numerical treatments so one can compare the equilibrium policies arising from 
different choices of discounting. The numerical scheme we employ consists of the discretization 
of the one dimensional equation in three steps. This is based on a Riemann sum approximation 
of the integral. We obtain closed form solutions in certain cases. 

We show that hyperbolic discounting may result in consumption patterns which are obser- 
vationally different from the optimal strategies in the Merton model. The latter predicts that 
consumption grows smoothly over time if the interest rate exceeds the discount rate (or decays 
smoothly otherwise). However, household data indicates that consumption is hump-shaped. 
This is referred to in the literature as the consumption puzzle, and we show that it can arise as 
a time-consistent strategy in certain cases of hyperbolic discounting. 

By running numerical simulations we study the effect of the weight given by the insurer to 
the beneficiaries on the life insurance process. 

Organization of the paper: The remainder of this paper is organized as follows. In section 
2 we describe the model and formulate the objective. Section 3 introduces the value function. 
Section 4 presents the main result. Section 5 deals with CRRA utilities. Numerical results are 
discussed in Section 6. An extension to multiple managers is discussed in Section 7. The paper 
ends with an appendix containing some proofs. 

2 The Model 

2.1 The decisions 

Consider a financial market consisting of a savings account and one stock (the risky asset). 
The inclusion of more risky assets can be achieved by notational changes. The savings account 
accrues interest at the riskless rate r > 0. The stock price per share follows an exponential 
Brownian motion 

dS(t) = S(t) [adt + adW{t)} , < t < oo, 

where {W(t)}t>o is a 1— dimensional Brownian motion on a filtered probability space, 

(fi, {J^jt^o, P). The filtration {Tt} is the completed filtration generated by {P^(t)}. Let us 

denote by fi = a — r > the excess return. 

A decision-maker in this market is continuously investing in the stock and the bond, con- 
suming and buying life insurance, while receiving income at the continuous deterministic rate 
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i(t). This assumption is key in deriving our results. Relaxing it to accommodate for problems 
relevant to small enterprises is not obvious and would be an interesting research project. 

Life insurance is offered as a sucession of term contracts with infinitesimally small horizon. 
At every time t, a contract is offered, costing 1 unit of account. If the holder dies immediately 
after, the insurance company pays / (t) to his/her beneficiaries. The deterministic function I (t) 
is prescribed. 

At every time t, the investor chooses CW> the investment in the risky asset, c(i) the con- 
sumption, andp(i), the amount of life insurance. Given an adapted process {((t), c(t),p(t)}t>o, 
the equation describing the dynamics of wealth X C " c,p {i) is given by 

dx^' c ' p (t) = rX^' c ' p (t)dt - c(t)dt - p(t)dt + i(t)dt + ((t)(a dt + adW{t)) 
A^' c ' p (0) = X(0), (2.1) 

the initial wealth X(0) being exogenously specified. 

We assume a benchmark deterministic time horizon T. The investor is alive at time t = and 
has a lifetime denoted by r, which is a non- negative random variable defined on the probability 
space (f2, J 7 , P) and independent of the Brownian motion W. Denote by g (t) its density and by 
G {t) its distribution: 



G{t) ^ P(r < t) = / g(u) du 



o 



It will be useful for later computations to introduce the hazard function \(t), that is, the 
instantaneous death rate, defined by 

m A lim nt<T<t + e\T>t)_ g(t) 



6t->o e 1 - G(t) ' 

so that g(t) = X(t) exp{— J Q * A(n) du}. We have, from the definition: 



(r < s | t > t) = 1 - exp{- J X(u) du}. (2.2) 



and 



P(r > T\t > t) = exp{- J X(u)du}. (2.3) 
Next we turn to risk preferences. 



2.2 Utility functions 

Definition 2.1 A utility function U is a strictly increasing, strictly concave differ entiable real- 
valued function defined on [0, oo) which satisfies the Inada conditions 

U'(0) = limU'{x) = oo, f/'(oo) = lim U'(x) = 0. (2.4) 
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The strictly decreasing C 1 function U' maps (0, oo) onto (0, oo) and hence has a strictly 
decreasing, C 1 inverse I : (0, oo) — >■ (0, oo). 

The legacy process of the decision-maker, {Z^ ,c,p (t)} t >o, is defined by 

Z^ p (t)± V (t)X^> p (t)+l(t)p(t), (2.5) 

where n (t) and I (t) are prescribed deterministic and continuous functions. The legacy is the 
sum of two terms: the first one, rj(t)X^ ,c ' p (t), is the part of his wealth which will benefit his 
heirs (after taxes, and various costs), and the second one l(t)p(t) is the life insurance. Although 
the insurance premium p(t) is allowed to be negative we require that the legacy Z^ ,c ' p (t) stays 
positive. A negative p{t) means that the decision maker can sell life insurance. 

Let Ui,U2,U3 be utility functions as in Definition 12. 1( XJ\ is the utility from intertemporal 
consumption, JJi is the utility of the final wealth and U3 is the utility of the legacy. 

Next, we define the admissible strategies. Sometimes, to ease notations, we write X t,x {s) 
and Z t ' x {s) for E[X^ p (s)\X<' c ' p (t) = x] and E[Z^' c ' p (s)\X^ c ' p (t) = x]. 

Definition 2.2 An M. 3 -valued stochastic process {C{t), c(t),p(t)}t>o is called an admissible strat- 
egy process if 

• it is progressively measurable with respect to the sigma algebra a({ W(t)}t>o), 

• c(t) > 0, Z^ c 'P(t) > for all, a.s.; X^(T) > 0, a.s. 

• moreover we require that for all t, x > 

E sup \U\(c(s))\ < 00, E\U2{X t ' x (T))\ < 00, E sup \U z {Z^ x {s))\ < 00. (2.6) 

{t<s<T} {t<s<T} 

The last set of inequalities are purely technical and are satisfied for e.g. bounded strategies. 
They are essential in proving our main result and are related to the fact that the expected utility 
criterion is continuously updated. 



2.3 The intertemporal utility 

In order to evaluate the performance of an investment-consumption-insurance strategy the de- 
cision maker uses an expected utility criterion. For an admissible strategy process 
{C(s), c(s),p(s)} s >o and its corresponding wealth process {X^ c ' p (s)} s >o, we denote the expected 
intertemporal utility by 



J(t,x,(,c,p) 



E 



TAt 



h(s - t)Ui(c(s)) ds + nh(T - t)U 2 {X^ p {T))l {T>T \ T>t} 



+ m(r - t)h(r - t)U 3 (Z^ p (r))l {T < TlT>t} 



X^ p (t) = x 



(2.7) 



where: 
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• n > is a constant 



• m (t) > is a continuous function 

• h and /i are continuously differentiable, positive and decreasing functions, such that h (0) = 
h(0) = 1. 

The interpretation is as follows. The decision-maker will collect X^' C,P (T) at time T, if he is 
still alive at time T, and the coefficient n is the weight he attributes to getting that lump sum, 
as compared to the utility of continuous consumption up to time T. The function h (t) is his 
discount function, and it is no longer restricted to the exponential and quasi-exponential type. 

He may, however, die before time T, in which case his wealth will accrue to others, and the 
decision-maker is taking the utility of his beneficiaries into account when managing his portfolio. 

Since the death time r is independent of the uncertainty driving the stock, we have the 
following simplified expression for the functional J, which is proved in Appendix A. 

Lemma 2.3 The functional J of (j2.7|) equals 



J{t,x,C,c,p) = E 



T 



Q(s,t)C/i(c(s))ds (2. 



+ J q(s, t)U 3 (Z^ x (s)) ds + nQ(T, t)U 2 {X l ' x {T)) 



where 



(2.9) 



q(s,t) = h(s - t)A(a) exp{- J X(z)dz}, h(t) = m(t)h(t) (2.10) 
Q(s,t) = h(s -t)exp{- / \{z)dz} (2.11) 



Jt 

A natural objective for the decision maker is to maximize the above expected utility criterion. 
However, because neither q nor Q are exponentials, time inconsistency will bite, that is, a 
strategy that will be considered to be optimal at time will not be considered so at later times, 
so it will not be implemented unless the decision-maker at time can constrain the decision- 
maker at all times t > 0. 



2.4 Time-consistent strategies 

We now introduce a special class of time-consistent strategies, which will henceforth be called 
policies. That is, we consider that the decision-maker at time t can commit his successors up 
to time e, with e — > 0, and we seek strategies which it is optimal to implement right now 
conditioned on them being implemented in the future. 

More precisely, suppose that a strategy / is time-consistent. This means that, if it has 
been applied up to time t, the decision-maker at time t will apply it as well. Since there is no 
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commitment mechanism to force him to do so, he will only apply strategy / if it is in his own 
best interests. Denote his current wealth by X(t). He has two possibilities: either to stick to 
the strategy /, or to apply another one. To simplify matters, we will assume that the decision- 
maker considers only a very short time interval, [t,t + e], so short in fact that all strategies can 
be assumed to be constant on that interval. The decision-maker then just compares the effect 
of investing £, consuming c and buying p worth of insurance, as required by the strategy / at 
time t, with the effect of investing consuming c and buying p worth of insurance, for different 
(constant) values. There will be, as usual, an immediate effect, corresponding to the change in 
consumption between t and t + e, and a long-term effect, corresponding to the change in wealth 
at time t + e. 

Let us formalize this idea: 

Definition 2.4 An admissible trading strategy {C(s),c(s),p(s)}t< s <T is a policy if there exists 
a map F = (F U F 2 ,F 3 ) : [0, T] x R -> R x [0, oo) x R such that for any t, x > 

liminf J(t,x,C,c-,p-)-J(t,x,C,c £ ,p £ ) > 
40 e 

where: 

C(s) = F 1 (s,X(s)), c(s) = F 2 (s,X(s)), p(s) = F 3 (s,X(s)) (2.13) 
and the wealth process {^(s)} s e[t.T] is a solution of the stochastic differential equation (SDE): 

dX{s) = [rX(s)+^F 1 (s,X(s))-F2(s,X(s))-F 3 (s,X(s))+i(s)]ds+aF 1 (s,X(s))dW(s). (2.14) 

Here, the process {( e (s), c t (s),p e (s)} se [ t ^ is another investment- consumption strategy de- 
fined by 

Ce ( s ) = <| s ^' "-f»-J\-',t (2 . 15) 

c e ( S ) = { 5(S) ' S£[t > Tm < (2.16) 



CM, 


s G [t,T]\E e> 


CM, 


s G E^ t , 


c(s), 


s G [t,T]\E e , 


c(s), 


s G E e>t , 


P(s), 


s€[t,T\\E e> 


p( s ), 


s G E t)t , 



p e (s) = {^ y n L ' J N (2.17) 

[p(s), s G E e>t , 

withE e ^ t = [t,t + e], and {((s),c(s),p(s)} seEeJ is any strategy for which {( e (s),c € (s),p e (s)} se [ ttT ] 
is an admissible policy. 

In other words, policies are Markov strategies such that unilateral deviations during an 
infinitesimally small time interval are penalized. Note that: 

• this does not mean that unilateral deviations during a finite interval of time are penalized 
as well: it is possible that deviating from the policy between t\ and t 2 will be to the 
advantage of all the decision-makers operating between t± and t 2 . 
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• however, if a Markov strategy is not a policy, then it certainly will not be implemented, 
for at some point it will be to the advantage of some lone decision-maker to deviate, 
during a very small time interval, which is enough to compromise all the plans laid by his 
predecessors. 

So time-consistency in the sense of Definition 12.41 is a minimal requirement for rationality: 
policies are the only Markov strategies that the decision-maker should consider. 



3 The Value Function 



We now extend to this situation the notion of a value function, which is classical in optimal 
control. Let m = m(0), and I\, I3 be the inverse functions of U'^U^. 

Definition 3.1 Let v : [0, T] x M. — > M be a C 1,2 function, concave in the second variable. We 
shall say that v is a value function if we have: 



v(t,x) = J(t,x,(,c,p). 
Here the admissible process {((s),c(s),p(s)} s£ [ t ,T] is given by: 



(3.1) 



a 



2 d 2 v 1 



dv 



dx 



1 



1(8) 



aJ(s,X(s)) 

where X(s) is the corresponding wealth process defined by the SDE 



m ox 



dX(s) 



rX(s) 



a 



2 d 2 v 
dx' 2 



(s,X(s)) 



\dx 



1 



+ *(*) 



<f0(aw) 



X(t) = x. 



(3.2) 
(3.3) 

(3.4) 



The economic interpretation is very natural: if one applies the Markov strategy associated with 
v by the relations (j3.2|) . and computes the corresponding value of the investor's criterion starting 
from x at time t, one gets precisely v (t,x). In other words this is fundamentally a fixed-point 
characterization. 

Let us define the functions Fi , F2 , F3 by: 



Fi(t,x) 



a 



2 d 2 y 
dx 2 



(t,x) 



dv 



, F 2 (t,x) ± h Tr(t,x) , F 3 {t,x) ± — 



Ox 



1 



l(t) 



h[-^x. 
m ox 



T](t)x 



(3.5) 
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Next we impose a technical assumption; for a C 1,2 function / : [0, T] X R — > R, let us define the 
operator Lf by 

df df a 2 F?(t x) d 2 f 
Lf(t, x) ± -±(t, x) + {rx + fiFtit, x) - F 2 (t, x) - F 3 (t, x) + *(t))^(t, x) + f^^d^ 2 ^ x) " 

Assumption 3.2 Assume that the PDEs 

Lf(t,x) = 0, f(s,x) = g(x), (3.6) 

have a C > solution on [0, s] X R — > R wi/i exponential growth. Here t < s < T, and g(x) is one 
of the functions 

Ui(F 2 (s,x)) : t < s <T, U 3 (i](s)x + l(s)F 2 (s,x)) : t < s < T, U 2 (x):s = T. 



4 Main Result 

The following Theorem states the central result of our paper. It involves the notions of policies 
and value function for which we gave economic intuition. 

Theorem 4.1 Let v be a value function which satisfies Assumption \3.SX Then, {C(s), c(s),p(s)} se ^ t ^ 
given by (13, 2p is a policy. 



We proceed in two steps. First we show that the value function v satisfies a partial differential 
equation with a non-local term and this is done in the following Lemma, which is proved in 
Appendix B. 

Lemma 4.2 The function v solves the following equation 

dv ( \ dv 

— (t, x) + irx + fiFx(t, x) - F 2 (t, x) - F 3 (t, x) + i(t)j — (i, x)+ (4.1) 
a2F ^ x) + Umfrx)) + mU 3 (x + l(t)F 3 (t,x)) = 



E 



" T ^(s, tp^F^s, X^(s))) ds + J ^(s, t)U 3 {Z^{s)) ds + n^(T, t)U 2 (X^(T)) 



with boundary condition v(T,x) = nU 2 (x), and the processes X of (12.141) . and Z t,x (s) 
7?(s)A*' a: (s) + l(s)F 3 (s, X^ x (s)). 
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We now proceed to the second step. In view of function's v concavity in variable x, and the 
definition of (F\, F 2 , F 3 ) (see (|3.5p ). the equation (|4.1|) can be re-written as 



dv . . 

— (t,x) + sup 



C.c,P 



dx 2 



^ 2 C 2 ^(i, x) + Ui(c) + mf/ 3 (r?(t)x + Z(t)p) 



(4.2) 



E 



We notice that 



Q (s,t)U 1 (F 2 (s,X t ' x (s)))ds+ f T ^(s,t)U 3 (Z^(s))ds + n^(T,t)U 2 (X^(T)) 



t Ot 



J(t,X,(e,C e ,p e ) - J(t,X,(,C,p) 



E 



t+c 



Q(s,t)[U 1 (c(s))-U 1 (F 2 (s,X t ' x (s)))]ds 



+ 



E 



t+e 



q(s,t)[U 3 (Z^(s))-U 3 (Z^( S ))]ds 



+ 



E 



E[v(t + e, X l ' x (t + e)) - v(t + e, X*' x (t + e))] + 
[Q(s,t) - Q(s,t- e)][[/ 1 (F 2 ( s ,X^( S ))) - U 1 (F 2 (s,X t ^(s)))} ds 



t+e 



+ 



E 



[q(s,t) - q(s,t- e)][U 3 (Z^(s)) - U 3 {Z^{s))\ ds 

t+e 



+ 



E [n[Q(T,t) - Q(T,t- e)][U 2 (X^ (T)) - U 2 (X^(T))}] . 

The RHS of this equation has six terms and we will treat each of these terms separately: 
1. In the light of inequality (|2.6p and the Lebesgue Dominated Convergence Theorem 



E 



lim- 



f t t+€ Q(*,t)[l7i(c( a )) -Um&X^isMds 



= [U 1 (c(t))-U 1 (F 2 (t,x))]. 
2. In the light of inequality (|2.6p and the Lebesgue Dominated Convergence Theorem 



E 



f t t+€ q( S ,t)[U 3 (Z^(s)) - U 3 (Z^(s))]ds 



lim- 

3. One has 



m[U 3 (x + p(t)l(t)) - U 3 (x + F 3 (t, x)l(t))}. 
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E[v(t + e,X t >*(t + e)) - u(t + e, + e))] = 

E[v(t + e, + e)) - v(t, x)] - E[v{t + e, + e) - «(t, x)]. 



Moreover 



E[v(t + e,X t ' x (t + e))-v(t,x)}=E / d[v(u, 



t+e 



Ito's formula yields 



lim 

40 



, <9t> . a 2 F?(t, x) d 2 v 
(t, x) + ( rx + /4Fi(t, x) - F 2 (t, x) - F 3 (t, x) + i(t) ) — (t, x) + ^ ^2 



<9r 
Ui 

Similarly 



(t,x) 



,. E[^(t + e,X^(t + e))- V (t,x)] Ej t t+e d[v(u,X^(u))} 
lim = lim — 



40 



€4.0 



dv 



at 



— (t,x) + ( r + /<(t) - c(i) - p(t) + i(t) ) — (t, x) + -a 2 C(t)-^(t, x 



dv 



dx 



4. In the light of inequality (|2.6p and the Lebesgue Dominated Convergence Theorem it 
follows that 



E 



lim- 



40 

5. Similarly 



E 



lim- 

40 

6. Finally, by the same token 



fL[q(s,t) - q(s,t- e)][U 3 (Z^(s)) - U 3 (Z^(s))} ds 



lim E [n[Q(T,t) - Q(T,t- e)][U 2 (X^ (T)) - U 2 (X^(T))j] = q 

40 € 



Therefore 



lim 

e4-0 



J(t,X,C,C,p) - J(t,X,(e,C e ,p e ) 



dv ( \ dv 

— (t,x) + \rx + fiF 1 (t,x)-F 2 (t,x)-F 3 (t,x)+i(t))—{t,x) 
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a 2 F?(t,x) d 2 v 
dx 2 



(t, x) + l/i(F 2 (t, x))) + mU 3 (x + l(t)F 3 (t, x)) 



2 

dv ( \ dv 

— (t, x) + ( r + /xC(t) - c(t) - p(t) + i{t))\ (t, x)+ 



where the last inequality comes from (|4.ip and (|4"|). 



> 0, 



□ 



5 CRRA Preferences 

Finding a value function is a complicated problem. We are able to deal with the case of power 
type utilities, that is (with some abuse of notations) U\(x) = ^(x) = U 3 (x) = U 1 (x) = 2L_, 
with 7 < 1. In this case we search for the value function v of the form 

v(t,x) = a(t)U y (x + b(t)), (5.1) 

where the functions a(t), b(t) are to be found. We consider here the case 7^0 (the case of 
logarithmic utility will be treated separately). In the light of equations (13. 5p one gets 



F x {t,x) 
F 3 (t,x) 



H{x + b{t)) 

(7 2 (l- 7 ) 

1 

W) 



F 2 (t,x) = [a(t)]T=i(x + b(t)), 



/r a(i),^_ . .. r af<), _JL__ . 

([— h- 1 -»7(*))» + [— h- 1 ^)) 



m 



(5.2) 
(5.3) 



By (|3.4j) the associated wealth process has the following dynamics: 



dX{s) 



r + 



1(a) 



X(s) + 



(72(l- 7 ) 



(X(a) + &(«)) 



- (o(a))7-i 1 + 



1 



tot -1 , 



(X(a) + &(«)) 



+i(s)ds + )/ ±-LLdW(s). 

(7(1-7) 

Let us define the process V(s) — X(s) + 6(s) which has the dynamics 



dY(s) 



l(s) 



Y(s) - [a(s)]— 1 + — Y(s) (5.4) 

V m—l{s)J 



7](s) 



l{s) 



ds + -^-dW(s). 

(7(1 - 7 ) 
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For considerations that will become clear later on we choose b(s) such that 

i(s) + b'(s) - (r + ^l)b(s) = 0, and b(T) = 0. 

l{s) 

By solving this ODE we get 

K*) = J i{u)e~ S ^ r+ ^) dx du. (5.5) 
Solving for the process Y(s) we get 

Y{S) = Y ®A£( r + &^ + ^ 
n{W{s)-W{t)) \ 
a(l- 7 ) J 

Therefore 

**<T) = I e xp (/ T ( r+5 ^ + ||-, aW )^( 1 + _2_)), ll 

fi(W(T)-W(t)) \ 
<r(l- 7 ) J' 

By plugging v of dSTTJ) ( with (Fi,F 2 ,F 3 ) of ([52]), (JO])) into §3J]) and ([33]), we obtain the 
following integral equation (IE) for a(t) 

,T g (,-t)+ (s: ^-7(aW) A + / ^ 

a(t) = / [Q(s,t)+q(s,t)](a(s))~e \ V m=Fri(*)/ / ds (5.6) 



K(T-t)+[ jf ^W_ 7(a(z)) ^T I !+_,!. 



+ nQ(T,t)e v v -"^'W/ /, a(T) = n 

with 

2(1 - 7 )a 2 ; ' 

Let us summarize this finding: 

Lemma 5.1 Let a(t) be a solution of the fixed-point problem (|5.6p . Define b(t) by (|5.5p . T/ien 
v(t,x) = a(t)U^(x + &(i)) is a value function. 
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We turn our attention to the integral equation (15. 6p . Set 



M(z) 4 1 + 



1 



(5.8) 



mf- 1 



l{z) 



Assumption 5.2 We require that: 



min (l-7M(t) + A(t)) >0 

t€[0,T] 



(5.9) 



The Assumption 15.21 is met if 7 < 0. If m = 1 and = -^y, then Assumption 15.21 is also 
satisfied (this is the situation considered by [28]). In the case when mm t& i ^(l — jM(t)-\-\(t)) < 
it can happen that a(t) reaches which leads to unbounded consumption. 

The following Proposition is proved in Appendix C. 

Proposition 5.3 If Assumption \5.S\ is satisfied, then there exists a unique global C 1 solution 
of the integral equation (15. 6p . 

In other words, for the problem under consideration, there always exists a value function 
of the special type v(t,x) = a(t)U 1 (x + b(t)) (note that there may be others as well). We now 
proceed to deduce the existence of policies. 

Theorem 5.4 Let v be the value function of Lemma \5.1[ Then, {C(s), c(s) , p(s)} s ^t,T\ given by 
(|3.2p is a policy. 

The proof follows from Theorem 14.11 Lemma 15.11 and Proposition 15.31 as long as we prove that 
{C( s ))C(s),p(s)}sg[t,T] i s an admissible strategy and Assumption 13.21 is met. The first claim 
follows if one establishes (12. 6p . Taking into account the special form of v, U-y, and X(s) + 6(s), 
(see (|5.4p ) then Burkholder Davis Gundy inequality yields (|2.6p . Next, to show that Assumption 
13.21 holds true boils down to construct a C 1 ' 2 solution to some PDEs. Again by exploiting the 
special structure, one can construct solutions (for the PDEs of Assumption I3.2[) of the form 
l(t)Ury(x + b(t)), with l(t) being the solution of some ODE. 

5.1 The Case of Logarithmic Utility 

In this special case we can solve the integral equation (|5.6p in closed form. Indeed with 7 = 
(the case of logarithmic utility) we follow the ansatz 



v(t, x) = a(t)Uj(x + b(t)) + d(t). 



(5.10) 



Then (|5.6p becomes 




(5.11) 
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with b(t) given in (15. 5j) and an appropriate choice of function d(t). The equilibrium policy is 
then given through (|3.5|) which becomes 



Fi(t,x) 
F 3 (t,x) 



^ X \ m \ F 2 (t,x) = [a(t)r\x + b(t)), 



1 

W) 



([ 



a(t). 



m 



rn 



(5.12) 
(5.13) 



Remark 5.5 Let us notice that the amount invested in the stock is the same as in the case 
of the standard Merton problem with exponential discounting. This somehow surprising result 
is explained by constant return and volatility for the stock. We conjecture that in a stochastic 
volatility model these amounts will be different. The consumption and insurance policies differ 
from the optimal ones except for the case of exponential discounting. In fact, this is the topic of 
the next subsection. 

5.2 The Classical Merton Problem 

The case of exponential discounting, h(t) = h{t) = e~ pt and constant Pareto weight m(t) = 
m, deserves special consideration. In that case, the equation (|4.ip becomes the classical HJB 
equation given by dynamic programming 

dv ( \ dv 

- (A(t) + p)v(t, x) + —(t,x)+lrx + fiF^t, x) - F 2 (t, x) - F 3 (t, x) + i(t) J —(t, x)+ 



a 2 F 2 (t,x) 8 2 v 



(t, x) + UJF 2 (t, x)) + mU^(ri(t)x + l(t)F 3 (t, x)) = 0, 



(5.14) 



2 dx 2 

with the boundary condition v(T,x) = nlly(x), and (^1,^2,^3) given through (13. 5J) . Therefore 
for the case of exponential discounting the optimal strategy given by dynamic programming 
coincides with the policy (given through (]3.ip . (I3.4p (I3.5P ). This non-linear equation can be 
linearized by Fenchel-Legendre transform and therefore it can be shown that it has a unique 
solution. Moreover, it can be computed by the ansatz (I5.ip . The function a(t) solves an ODE 
which can be solved explicitly to yield 



a(t) 



— r 



l- 7 ' 



+ 



1 + X(u) - jM(u) ^ j-« K+ M 



1-7 



-ds 



du 



1-7 



with K given by (|5.7p and M(z) given by (|5.8|) . 



5.3 The Merton Problem with Hyperbolic Discounting 

In this section we assume that the decision- maker gets no income (i(t) = 0), he/she does not buy 
life insurance and there is no possibility of him/her dying before T. Moreover, we assume that 
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_*2 

discounting is hyperbolic, i.e., h(t) = (1 + kit) fc i , with fci,/^ positive. In [21] it is shown that 
CRRA type utilities and hyperbolic or exponential discounting exhibit the common difference 
effect. Due to this effect, people are more sensitive to a given time delay if it occurs earlier than 
later. More precisely, if a person is indifferent between receiving x > immediately, and y > x 
at some later time s, then he or she will strictly prefer the better outcome if both outcomes are 
postponed by some time t : 

U(x) = h(s)U(y), implies that U(x)h(t) < h(t + s)U(y). 

Furthermore, they assume that the delay needed to compensate for the larger outcome is a linear 
function of time, that is 

U(x) = h(s)U(y), implies that U(x)h(t) = h(kt + s)U(y), 

for some constant k. They show that the only solution of this functional equation is U(x) = — . 
We pay special attention to this case because it explains the consumption puzzle; there is a 
satiation in the consumption rate before maturity and exponential discounting can not capture 
it (in fact with exponential discounting the optimal consumption rate is either increasing or 
decreasing at all times depending on the relationship between the discount rate and the interest 
rate). Moreover, it says that optimal strategies and policies are not observationally equivalent. 
In the following we illustrate this point by a numerical experiment. 

We consider one stock following a geometric Brownian motion with drift a = 0.12, volatility 
a = 0.2, interest rate r = 0.05, and the horizon T = 4. This set of parameters is chosen for 

illustration. Inspired by [20j let the discount function h(x) = (1 + k±x) fc i be one of the three 
choices of hyperbolic discount: case 1. k\ = 5; case 2. ki = 10; case 3. k% = 15; and b is chosen 
such that /i(l) = 0.3. We set 7 = — 1 (this choice reflects risk aversion). Let us consider three 
cases: n = 1, 10, 30. We apply the numerical scheme developed in the Numerical Results Section. 

As we see from these graphs, the consumption rate policy is increasing up to a satiation point 
after which it is decreasing. This phenomena is observed from the data (people are consuming 
more and more up to some age (around 60 years) after which the consumption is decreasing). 
This may be explained by a drop in income. As the parameter n gets higher (when the agents 
get more utility from terminal wealth) the satiation point comes earlier. 

Lemma 15.61 shows that consumption rate policy is not always monotone. 

Lemma 5.6 One can find a hyperbolic discount function such that the consumption rate policy 
is neither increasing nor decreasing in time. 

Appendix D proves this Lemma. 
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5.4 The Stationary Case 

Let us now consider the stationary problem. The coefficients in the model are assumed constant 
taking their stationary value, i.e., n = 0, m(t) = m, l(t) = I, X(t) = A, i(t) = i,rj{t) = r], and 
T = oo. For simplicity we assume that 

q(s,t) = mAexp{-(A + n)(s - t)}, Q{s,t) = exp{-(A + r 2 )(s - t)}, 

for some r\ and r 2 positive. Before engaging into the formal definition, let us point the following 
key fact. For an admissible time homogeneous (stationary) policy process {C(t), c(t),p(t)}te[o,oo) 
and its corresponding wealth process {-X"(i)}te[o,oo) ( see (|2.ip ) the expected utility functional 
J(t, x, C, c) is time homogeneous, i.e., 

J(t,x,(,c,p) = J(0,x,C,c,p) 



E 



POO POO 

/ exp{-(A + r 2 )s}U(c(s)) ds + mX exp{-(A + n)s}U(Z ' x (s)) ds 
Jo Jo 



The intuition is that the clock can be reset so that the expected utility criterion takes zero as 
the starting point. We have a similar definition for policies as in the case of finite horizon. 

Definition 5.7 An admissible trading strategy {C( s )> c(s),p(s)} sG [o i00 ] is a policy if there exists 
a map F = (F 1 ,F 2 ,F 3 ) : R ->■ R x [0, oo) x R such that for any x > 

liminf j(o,x,c,c,p)-J(o,»,C e , Ct ,p e ) > (515) 

40 e 

w/iere 

C( S ) = i^s)), c(s) = F 2 (X( S )), p( a ) = F 3 (X(s)) (5.16) 

and t/ie wealth process {^(s)} s g[o,oo] ^ s a solution of the stochastic differential equation (SDE) 

dX(s) = [rX(s) + MFi(X(s)) - F 2 (X(s)) - F 3 (X(s)) + i(s)]ds + ai^X^cW^s). (5.17) 

Moreover, the process {Ce( s )> c e (s),Pe(s)} sG [o i0 o] another investment- consumption strategy 
defined by 

C 6 (*) = 4 SW ' ° C L"^JN^ (5 . 18) 

fc(a), S G[0,oo]\£J e 

c e( s ) = S , s „ ( 5 - 19 ) 



lOT'tfi E'e = [0, e], and {((s), c(s),p(s)} seEt is any strategy for which {( e (s), c e (s),p € (s)} se [o,oo] is 
an admissible policy. 



CO), 


s G [0,oo]\£; e 


C(s), 


s E £ e , 


c(s), 


s E [0,oo]\.E £ 


c(s), 


s E E e , 


P(s), 


s E [0,co]\£ e 


p( s ), 


s E £? e , 
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Similarly we define the value function. 

Definition 5.8 A function v : R — >■ R is a waZite function if it solves the following system of 
equations 

v(x) = J(0,x,(,c,p) (5.21) 
C(s) = F 1 (X( S )), c(s) = F 2 (X(s)), p(s) = F 3 (X(s)), 

dX(s) = [rX(s) + - F 2 (X(s)) - F 3 (X(s)) + + aFi(X(s))dW(s), (5.22) 



1 V 

— f (x) — nx 
m J 



(5.23) 



Let us look for the value function of the form 

v(x) = aU 7 (x + b), (5.24) 

i 

for some constants a and 6. By solving (3.4), we get b = j^pr- Let /3 = 1 + m ; 7 and K be 
given by (|5.7p . The constant a should solve the following equation 

7 

Q7 -l (A ) 7 -l 

— + mA ^ — (5.25) 



A + n - F - 22 + 7 /3a~ A + r 2 -F-22 + 7/3a~ 

with the transversality conditions 

A + rj -F- y +7^^ > .7 = 1,2. (5.26) 

Lemma 5.9 There is a unique solution of (|5.25p and (|5.26D . 
Appendix E proves this Lemma. 

We are ready to state the main result of this section. 

Theorem 5.10 Let v be defined by (|5.24p with a the solution of (|5.25[) . The function (Fl, F 2 , F3) 
0/ (I5.23P defines a policy through (15.170 and (|5. 1611 . 
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Proof: The proof for the most part parallels Theorem 14. 1[ The only part which requires 
more analysis is showing that 



limE / exp{-(A + ri)s}[UJF 2 (X°' x (s))) - UJF 2 (X°' X (s)))] ds 
<40 \_J e 

which is equivalent to 



0, i = l,2. 



limE 

40 



exp{-(A + nWKX^is) + b)'' - (X°> x (s) + by] ds 



0,, z = 1,2. 



The result follows from Lebesque Dominated Convergence Theorem if we prove that 



E 



exp{-(A + n)8}[(X u ^(8) + by + (X°> x (s) + by] ds 



< 00, i = 1,2. 



(5.27) 



Notice that from the transversality conditions (|5.26p one gets 



E 



exp{-(X + r l )s}(X^ x (s) + b) 



< 00, i = 1,2. 



Moreover, if s € [e, 00] then 

'X°> x (s) + bY (X°^{e) + b^ 1 



X°> x (s) + bJ \X°> x (e) + b 



R(e), 



and R(e) and X ,x (s) are independent. Thus, Holder inequality and a standard argument yields 



E 



POO 

/ e W {-^ + n)s}(X°' x (s) + by 
Jo 



< 00, i = l,2, 



so (|5.27p holds true. 



□ 



6 Numerical Results 

We provide a numerical scheme to approximate the integral equation (|5.6p . For simplicity we 
assume that rj(t) = 1. In a first step let us discretize the interval [0, T] by introducing the points 
t n = T + nh , where e = — j^; recall that with K given by (15. 7j) and M(-) of fj5.8j) . the equation 
(|5.6p becomes in a differential form 
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a'(t) = ( 7 M(t) - A(t) - l)(a(t))=fr + (\(t) - ^ _ ^ - K - jL ) a(t) (6.1) 
+ j\(s,t)(a(s))^ (^^^ 



where 



and 



A(s)=exp(^ 7(d(z))^M(^z) 



h'(T-t) h'(s-t\„. . fh'(T-t) h'(s-t). 



From the definition of ^4(s), it follows that 



gJt 1 l{u) 



A'(s) = -ja(s))~M(s)A(s). 

Our approximation scheme is done in three steps. In a first step, we construct the sequence 
a\ and A\ recursively by 

a\ +1 ±al + ea'(t n ), A l n+l 4 A\ + eA(i n ). 
Lemma 6.1 i/a^ and A* , re = 0- ■ ■ N are defined by ag = 1, Ag = 1 and 



= 4 + e(( 7 M(i n ) - A(t n ) - l)(ai)^i + (a(*„) - - K - jfa) a l n 

+ f t T n L(s,t n )(a(s))^(^)d S 



> K+l = K-l«tn))^M{t n )Al 
Then there exists a constant C such that 



\al-a{t n )\ <C|e| and \A\ - A(t n )\ < C\e\, Vn£0,l,--- ,N. 
Appendix F proves this Lemma. 



In a second step we discretize the integral L(s,t n )(a(s))^- 1 ( A(t\ ) This will lead to 
the following Lemma. 



Lemma 6.2 If a\ and A\, n = • • • N are defined by = 1, Ag = 1 and 



21 



' «n+i = 4 + <jM(t n ) - X(t n ) - l)K)^ + e (\(t n ) - - if - I ^ y ) a* 

. A 2 n+1 = A 2 n - 7 e(a 2 n )^M(t n )A 2 n 
Then there exists a constant C such that 

\a 2 n -a l n )\ < C\e\ and \A 2 n -A l n \ < C\e\, Vn € 0, 1, • • • ,N. 
Appendix G proves this Lemma. 

In a third step we introduce an explicit scheme. 
Lemma 6.3 If a 3 and A^, n = • • • N are defined by = 1, Aq = 1 and 

' <+i = a* + <lM{t n ) - X(t n ) - l)(a3)^r + e (x( tn ) - - K - ^) o? n 

. A 3 n+1 = A3 - 7 e( a 3)^iM(t n ) J 43 
Then there exists a constant C such that 

\a? n -a 2 n )\ < C\e\ and \A\ - A 2 n \ < C|e|, Vn € 0, 1, • • • ,N. 
Appendix H proves this Lemma. 

By using the preceding lemmas and Lipschitz continuity of function a(t) we summarize the 
results of this section by the following Theorem. 

Theorem 6.4 Let a]y(t) be the function obtained by the linear interpolation of the points 
(t n =T-^,a 3 n ). Then 

\a N (t)-a(t)\<C\e\, Vi € [0, T] , 
for some positive constant C independent of N. 

In the following we perform a numerical experiment. Let T = 4, r = 0.05, p = 0.07, a = 
0.2, p = -1,N = 1000,/) = 0.8, A(t) = 2S0 + mot,l(t) = jmiVtt) = l , The discount function is 

exponential h(t) = h(t) = exp(-pt) with p = 0.8. The Pareto weight is m(t) = log( r+ £ £ ~* ) with 
e = 10~ 15 . We choose this set of parameters for illustration. As people get older, perhaps they 
weigh more their heirs utility; so a time decreasing aggregation rate seems the natural choice. It 
is for this reason that we consider a decreasing function m. We plot the maps F<i and F$ which 
lead to the policies. Furthermore, we plot the difference in F% when m is variable as opposed to 
m is constant. The results show that higher utility weight m leads to higher amount spent on 
life insurance. 



22 



7 Conclusion and future research 



We have studied the portfolio management problem in which an agent invests in a risky asset, 
consumes, and buys life insurance in order to maximize utility of his/her and heirs. Different 
discount rates for the agent and heirs lead to time inconsistency. Moreover a time changing 
aggregation weight will lead to time inconsistency as well. The way we deal with this predicament 
is by looking for subgame perfect Nash equilibrium strategies that we call policies. We find them 
in special cases. Our model is rich enough to capture different aspects in portfolio theory. We 
perform numerical experiments in order to explain the effect of discounting in one hand and the 
effect of aggregation on a different hand. Hyperbolic discounting is emphasized in a Merton type 
problem (for simplicity we shut off some parameters). The surprising result is that the policies 
and optimal strategies are not always observationally equivalent. For example, in certain cases, 
watching one's consumption rate we can infer (from its time monotonicity) wether or not is a 
optimal or a equilibrium one. Indeed, a non monotone consumption rate can not be optimal for 
the case of exponential discounting. The consumption rate policy exhibit a satiation point (it 
has a hump shaped behaviour) and this may explain the consumption puzzle. A time varying 
aggregation rate is benchmarked to a constant one. Our numerical experiment comes to support 
the intuition that the more the manager cares for his/her heirs, the more he/she will pay on life 
insurance. 

We have introduced a system of equations: the integral equation (13.ip together with the 
SDE (|3,4p and PDE (|3.5[) . Their validity has been established in the case when the utility 
function and the bequest function are of (CRRA) type, but we think that it extends to any 
concave utilities, as in the deterministic case. This paper can be seen as a first step in the 
general direction of extending stochastic control away from the optimization paradigm towards 
time-consistent strategies. The mathematical difficulties are considerable: we have no general 
existence nor uniqueness theory for the equations (|3.ip or (|4.ip . which replace the classical HJB 
equation of optimal control. In the present paper we sidestep the difficulty by using an Ansatz, 
but we hope that future work, by ourselves or others, will solve these problems. 

We conclude by pointing out that most portfolios are not managed by an individual, but by 
a group, either a professional management team, or the investor himself and his family. As we 
mentioned in the introduction, we should then introduce one utility function, one psychological 
discount rate, and one Pareto weight for each member of the group. Consider for instance a 
group with two members (husband and wife). Member i (for i = 1,2) has utility Ui(ci,C2), 
where c\ is the consumption of the husband and c 2 is the consumption of the wife, and discount 
factor hi (t), so the utility derived at time t by member i from the couple consuming (ci, c 2 ) at 
time s > t is hi (s — t) U{ (pi, c 2 ). The utilities of the husband and the wife have to be aggregated 
by Pareto weights. If for instance we assume that, as is the case in most couples, one member 
specializes in long-term decisions and the other in short-term ones, we find that there should 
exist some decreasing function \i (t) , with < fj, (t) < 1, such that the behaviour of the couple 
between t and T is adequately described by maximising the intertemporal criterion: 




[// (s - t) hi (s - t) m (ci (s) , c 2 (s)) + (1 - (s - t)) h 2 (s - t) u 2 (ci (s) , c 2 (s))] ds 
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plus some terminal criterion (legacy) at time T. Even in the case when both members of the 
group have a constant psychological discount rate, so that hi (t) = exp (— nt), and even if n =7*2, 
the group will exhibit time-inconsistency. 

Our model covers the particular case when u\ = u 2 = U. This group is time- inconsistent: 
their expected intertemporal utility is: 

J(t,x,C,ci,c 2 ) = E / hi(s -t)U(c 1 (s))ds+ ( m(s - t) h 2 (s - t)U(c 2 (s)) ds 
_ Jt Jt 

+ hx{T -t)U(X^' C2 {T)) 

which falls within our model. Assuming that the function m(-) is decreasing with m(0) ~ 00, 
and m(T) ~ would capture the situation when one member plans for short time and the other 
plans for long time. 

The more general case when u\ 7^ u 2 together with other macroeconomic problems with 
heterogeneous agents will be the subject of future research. 



8 Appendix 

Appendix A: Proof of Lemma 12.31 We first establish that 



E 



TAt 



h(s - t)Ui(c(s))ds 



E 



Q(s,t)Ui(c(s))ds 



.1) 



In the light of equations (I2.2p , ()2.3p and the random variable r being independent of Brownian 
motion W it follows that 



E 



TAt 



Moreover 



h(s - t)Ui(c(s)) ds 



E 



■T 

exp{- / X(z)dz} h(s - t)Ui{c(s)) ds+ 



E 



A(n)exp{— / X(z) dz} / h(s — t)Ui(c(s)) dsdu 
Jt Jt 



T pu pu 

A(u)exp{— / X(z) dz} / h(s — t)Ui(c(s)) dsdu 
Jt Jt 



-E 



d_ 

du 



exp{— / X(z)dz}\ / h(s — t)Ui(c(s)) dsdu 



and integration by parts will lead to (|8.ip . It is easy to see that 



E 



h(r -t)C/ 3 (^' x (r))l {r < T | TM} 



E 



q(s,t)U 3 (Z^(s))ds 



■2) 
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Finally let us prove that 



E 



E 



nQ(T,t)U 2 {X^ x {T)) 



(8.3) 



nh(r - t)U 2 (X^(T))l {T>TlT>t} 
This follows from ([273]). In the light of flHTH) (JE/J) and ([13]), it follows that f$2J$ holds true. 

□ 

Appendix B: Proof of Lemma [4.2t Let the functions (t, x) —> f l {t, •, x) satisfy the following 
PDEs: 

d P 9 P cr 2 F?fi x~) <9 2 P 

^ + (rx + /xFi(t,x)-F 2 (t,x)-F 3 (t,rE) + i(t))^ r + 2 ' ax 2 = °' i = 1 ' 2 ' 3 - ( 8 - 4 ) 

with the boundary conditions 

f\t,8,x) = U 1 (F 2 (s,x)), f 2 (t,s,x) = U 3 ( V ( S )x + l(s)F 2 (s,x)), f(t,T,x) = U 2 (x). 

In the light of Assumption 13. 2\ these PDEs have C 1,2 solutions. According to the Feyman-Kac's 
formula 

f 1 (t,s,x)=E[U 1 (F 2 (s,X^(s)))}, f(t,s,x)=E[U 3 (Z t > x (s))], f 3 (t,T,x) = E[U 2 (X t,x (T))]. 
Therefore 

f T 

v(t,x) = J (Q(s,t)f\t,s,x)+q(s,t)f 2 (t,s,x))ds + nQ(T,t)f(t,T,x) (8.5) 
By differentiating under the integral sign in (|8.5p we obtain 



dv r T df 1 df 2 df 3 

— (t,x) = J (Q( s ,t)^(t,s,x) + q(s,t)^(t,s,x))ds + nQ(T,t)-^(t,T,x) (8.6) 

+ (Q(t, t)f\t, t, x) + q(t, t)f 2 (t, t, x)) 

+ / T (|r (s ' t)fl (t ' s ' x) + (s ' t)/2(t ' s ' x)) ds + n ^ (T ' t)f3{t ' Ti x) ' 



aw /" T df 1 df 2 df 3 

7r (t,x)= / (Q(s,t)^-(t,s,x) + q(s,t)^-(t,s,x))ds + nQ(T,t)^-(t,T,x), (8.7) 

ax ax ox ox 



and 



a 2 v /- T a 2 P a 2 f 2 a 2 f 3 

^(t,x) = y {Q(s,t)-^ T (t,s,x) + q{s,t)-^ T (t,s,x))ds + nQ(T,t)-^ T (t,T,x) (8.8) 



By combining ([12]), ([577)1 . (1878)) and ([5711), we obtain (B~T1) . 
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□ 

Appendix C: Proof of Proposition 15.31 We proceed in a couple of steps. In a first step, 
we obtain lower and upper bounds for a(t). The second step shows that for the case of discount 
functions being a linear combination of exponentials the equation becomes an ODE system for 
which we have local existence. The local solution together with the bounds obtained in the first 
step will lead to global existence. In a last step, we approximate the discount functions by linear 
combination of exponentials and the solution is constructed by the limit of the ODE systems 
solutions. In the following, we will go over step one only since the second step follow as in |10j 
and the last step follows from a density argument. For simplicity we assume that rf(t) = 1. Now, 
let us define 

K(t-T)+J t T f-jfa+yais) ^ M{z)\ dz 



a(t) = a(t)e 



It follows that 



-M F \n( +\ i / rtir/rt \K{s-T)-jj(^- +1 {a{z)Y^M{z)d Z ) 

= J [<2(M) + q(s,t)\ [a(s)]7-i e L \" J 



ds + nQ(T,t) 



Consequently 



a'(t) = -{Q(t,t) + q(t,t))(a(t))S-*e 







-[Q(s,t)+q( S ,t)] (a(a))7-i c 



K{*-T)+S: [j^+^a(z))^M(z) \dz 



ds + n^Q{T,t) 



ds 



From direct calculations 







and 



-Q(T,t) = (X(t)h(T-t)-h'(T-t))exp 
= (X(t)-j(T-t))Q(T,t) 



^[Q(s,t) + q(s,t)} = {\{t)h(s-t)-h'{s-t))exp 



X{z)dz 



\{z)dz 



+ X(s)(X(t)h(s-t)-h'(s-t))exp 



X(z)dz 



Therefore 



Q / h'(s-t) \ / h'(s-tY 

- [Q(s, t) + q(s, t)} = \\(t) - (s - t)j Q(s, t) + \\(t) - j^—^ ) 
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Thus 



a'(t) = -(\(t) + l)(a(t))—ie 
h'(T - t) 



K(t-T)-J t T ( T^+lHz)} T-T M (z) ) dz 



ds 



+ n A(t) 



h(T - t) 



Q(T,t) 



A(i) 



h'(s - 1) 
h(s-t) 



Q(s,t)+(X(t) 



h'(s - t) 
h(s - t) 



q{s,t) 



x (a(s))~'- 1 e 



K{s-T)+Sj ^j+7(a«) ^ M(z) ) dz 



ds 



Hence 



{(a'(t) + (K + ^-i(a(t))^M(t))a(t))e 



(\(t) + l)(a(t))—ie 
h'(T - 1) 



+ nlA(t) 

fT 

+ 



A(i) 

7 

x (a(s))T- 1 e 
Consequently 



h{T - t) 
ti(s-t) 



It ( K +m) dz+ $I ^ M W d * 

~ St ( K +W) ) dz+ ft T 7(<>W) {z)dz 

Q(T,t) 



Q(s,t)+[\(t) 



h'(s-t) 



h(s-t) J -* v ~'" v 1 \' h(s-t) 

■ Si ( K +T&) dz +Sl 7(«W) ^ Af (*)d« 



g(s,i) 



ds 



(a'(t) + + - 7 (a(t))=FTM(t))a(t) 



-(A(t) + l)(a(t))— + n ( A(t) - ) Q(?,t)e 



St K +iHl dz Sl 7(«W) ^ M(*)cfa 



T [(^)-tf|)«M) + (A( t )-ff|] 9 (M) 
From the definition of a(t) we get that 



(a(s)) t- 1 e 



(a'(t) + (K + - T (a(t))^M(t))a(t) 



-(A(t) + l)(a(i))^ + x(t)a(t) - % {t) 



h{T - 1) 



(8.9) 
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f T ( ti(T -t w „, . , ^ ti(s-t),„, . 
+ J t [ h{T _ t )(Q( s ^) + l(s,t)) - A- J (Q(s,t) 

h'(s - t) 



h(s-t) 



(s,t) (o(s))^e 



h(s - t) 

K(s-i)+f* ~f[a(z)]T^M(z)dz 



ds 



Since — p < 7^(2) < p and — p < j^(z) < p and — p < < p' for < z < T the equation 
E3D leads to 



a'(t) < -(1 + X(t) - jM(t)){a(t))~ + (A(i) + 3p — + p>(f) ( 8 - 10 ) 



and 



o'(t) > "(1 + A(t))(a(t))— - (K + X(t) + 3p- p')a(t) 



Let us denote 



Ci = min (1 - 7 M(i) + A(t)), C = max (A(t) + 3/9 - if + p') 
te[o,T] te[o,T] 



.11) 



L> = max (K + A(i) + So), D x = max (1 + X(t)) 



.12) 



so that equations ()8.10p and (18. 11 f) will become 

a'(t) < -Ci(a(f))^ + c a(t) 
and 

a'{t) > -Z?i(a(t))^ - D a(t) (8.13) 

Now, Cq,Di,Dq > and by assumption 15.21 it follows that C\ > 0. Consequently, we get 
lower and upper bounds on a(t) by integrating fl8. 12f) and (I8.13P as in |10| . 

□ 

Appendix D: Proof of Lemma 15.61 We take n = 2 and the coefficients as in the numerical 
experiment. In the light of the differential equation 



At) 



h'(T-t) 
h{T-t) 



+ K 



a(t) + ( 7 -l)(a(t))7- 



5.14) 



rT q 
I MT- t) - 



h(s - 1) 
h(T - 1) 



(a(sj)T- 1 e \ /as. 



We notice that on [T — e, T] 
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a'(t) 



h'(T - t) 



+ K 



a(t) + ( 7 -l)(a(t))^+0(e). 



h(T - 1) 

Consequently, for the choice of our parameters in the numerical experiment we get that 
T-t) 

h(T-t) 



— + K < — 1 for small e (keeping in mind that a(l) = 2) we see that a(t) is increasing on 



h(s-t) 
h{T-t) 



< 0. It is obvious that 



[T — e,T]. For hyperbolic discounting it can be shown that 
a(t) is decreasing in a neighborhood of due to the negative contribution of the term 

h(s - 1) 



T d 



h(T - 1) 



i i w — — — -[Jt~tnu))^du 

(a(s)j -i- 1 e 



ds. 



In conclusion, the consumption rate policy, F2 ^' x ^ = [a(t)]-> - 1 , (see (|5.2p ) is neither increasing 
nor decreasing in time. 



□ 



Appendix E: Proof of Lemma l5.9t Let x = a 1 ~T , ctj = A + rj — K — 22, j = 1,2. Equation 
(|5.25p becomes 



1 



1 



+ 



Am 1 - 



For the sake of simplicity, consider the case m = 1. 
We want to find x > which solves 

7/3(1 - 7/3 + X)x 2 + (a 2 (l - 7/?) + ai(A - 7/3))a; - aia 2 = 
and transversality conditions (|5.26|) i.e 

ol\ + 7/3x > Q2 + 7/3x > 



(8.15) 



5.16) 



5.17) 



This can be done by splitting the analysis into 3 cases: 7 G (0, 1), 7 = 0, and 7 < 0. We omit 
the details. 

□ 

Appendix F: Proof of Lemma 16.11 Let a = inf t ^Q^a{t). Lemma 15.31 guarantees that 
a > 0. We show that 



2A 

4>^- Vne0,l,--- ,N, 



(8.18) 



and this makes the recursive scheme well defined. We prove (|8. 18[) by mathematical induc- 
tion. Assume that 
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2A 

4>^" VfceO,l,--- ,n, (8.19) 



and prove that a\ +l > Let us define 

e n = a n ~ a {tn)i fn = — ■^■{pn) 

By considering a second order Taylor expansion of a(t n +i) at a(t n ), we get 

a(t n+ i) = a(t n ) + ea'(t n ) + c n e 2 

with c n a constant depending on a and bounded by c independently of n. Consequently 

e n +i = 4+1 — a(t n +i) 

= 4 + e(( 7 M(i n )-A(i n )-l)(4)^ 

+ ( A «»> " TO " *) "i + (^) * 

a(t n ) + e( 7 M(g - A(t n ) - l)(a(t n ))^ 



-i 



e n + e( 7 M(i B ) - A(t„) - 1)(«)^ - (0(^)7-1) 



+ e [Ktn) ~ h(T _ tn) ~Kje n - c n e 

7 

By the mean value Theorem applied to the function x i^ 1 , one gets that 

|(4)^ - (a(t k ))^\ < 7-1 |4 _ a{tk) \. 

Therefore there exists M > 0, such that 

|ejfe+i| < |e fc |(l + Af|e|) + ce 2 , V* € 0, 1, ■ ■ ■ ,n. (8.20) 
By iterating (|8.20j) for k = ■ • • n, one gets 



2 (1 + Me) n+1 -1 . . 2 e MT -l 
|e n+ i| < ce 2{ - -L < |c|e 2 — ^ — < C\e\, 

N 

for some constant C independent of n. Therefore 
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> a(*n+i) - l e n+il >a~ C\e\ > 2a/3 

for |e| small enough. This proves (|8.18p . 
Moreover it follows that 

\a\ -a(t n )\ = \e n \ <C\e\, Vn G 0, 1, • • • , N. 
Similar arguments show that 

\Al-A(t n )\ <C|e|, Vne0,l,--- ,N. 



□ 



Appendix G: Proof of Lemma 16.21 We show that 

a 2 n >^ VneO.l,--- ,A, 



(8.21) 



and this makes the recursive scheme well defined. We prove (|8.2ip by mathematical induc- 
tion. Assume that 



4>2 VfceO.l,--- ,n, 



and prove that a^ +1 > ^. Let r n = a 2 — a*, so 

2 1 
~n+l — a n+l a n+l 

= a 2 n + e( 7 M(i n ) - \{t n ) - l){a 2 n )^ + e ^A(t n ) 

- e 2 |^L(t J ,t n )(a(t i ))^iA(t i )-e^ L(«, i n ) (a(s))^ (^^) ds 

- ai - e( 7 M(i n ) - \{t n ) - l){a l n )^ - e (\(t n ) - " #i a} 
= r n + e( 7 M(t n ) - \(t n ) - l)((a£)^ - (O^) 



(8.22) 



L(s,t n )(o(s))T- 



ds 
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Moreover 



eL(t v t n )(a(t 3 ))^ " / 3 L(s,t n )(a(s))^ ) ds\ 



A(t n )J J tj+1 * ' * " V^(<n) 

rL(t i ,t n )(a(t j ))^ (|||y) -i(*,tn)(a(*))^ (^j)) <M 

" 1^)1 1 3 (l^i^Wtj^Aitj) - L(s,t„)(a(t J ))^ T ^(ti)] + [L( S ,in)(a(ii))^(i;) 
- L(a,t n )(a(a))^A(tj)] + [L(s, t n )(a(s))^ A{tj) - L(s, t n )(a(s))^ A(s)]\ ds\ 
< {K {tj - t J+1 f + K^tj - t J+l f + K 2 {tj - t J+l f) < K A e 2 , 

for some positive constants Kq, K\, K2,K^. The last inequalities follow from the boundedness 
of a(t) ( see Lemma l5.3p and from the boundedness of coefficients. Arguing as in Lemma 16.11 
we can then find M > such that 

kfc+i| < \r k \(l + M\e\) + ce 2 , Vfc 6 0, 1, ■ ■ ■ ,n. (8.23) 
By iterating (|8.23[) for k = ■ • • n, one gets 

2 (1 + Me) n+1 -1 . . 2 e MT -l „. , 
\r n+ i\ < ce 2{ - jL < \c\e 2 ^^- < C\e\, 

N 

for some constant C independent of n. Therefore 

a 2 n+ i > a\ +1 - \r n+1 \ > 2a/3 - C\e\ > a/2 
for |e| small enough. This proves (|8.2ip . Moreover it follows that 

\ a n ~ a n\ = \ r n\ < C|e|, Vn G 0, 1, • • ■ , N. 
Similar arguments show that 

\A 2 n - Ai\ < C\e\, VnG0,l,--- ,N. 



□ 



Appendix H: Proof of Lemma 16.31 We show that 



al>- A VneO,l,-" ,N, (8.24) 

and this makes the recursive scheme well defined. We prove (|8.24j) by mathematical induc- 
tion. Assume that 

4>| VkGO.V-.n, (8.25) 
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and prove that a^+i > f . Let us introduce u n = a„ — a 2 and v n = — A\. It follows that 
3 2 

H71+I — a n+l ~~ °n+l 

= a* + e ( 7 M(t n ) - A(t») - l)(a»)^ + e (xfa) - l^-t) " K ) °" 

n-1 

- e 2 ^L(t i ,t n )(af)^f - a 2 - e( 7 m(t n ) - \{t n ) - l)(a 2 )^ 

= w n + e( 7 m(t n ) - A(t n ) - l)((a3)^r _ ( a 2 )^) 

(h! (T t ) \ n— 

where rj >n = (a^)~ f -^f j — f . By triangle inequality it follows that 



' 3,n\ 



- ^ (4) " (o?) ^ (I) 1 + l(o?) ^ (I) " (I 



< Mi\uj\ +M 2 \vj\ +M 3 \v n \ + M 4 |e|, 

for some positive constants Mi, M2, M3, M4, where the last inequality from the boundedness 
of a(t) ( see Lemma I5.3P and of other coefficients in our model. Arguing as in the previous 
Lemmas one can find a positive constant C such that 

\u n +\\ < \u n \ + C\eu n \ + C\e\(maxj e o t ... >n \uj\ + maxj e0) ... )H \vj\) + Ce 2 . (8.26) 

On the other hand 

Vn+i =v n - jeM(t n )((a 3 n )^pl - (a 2 )^ip 2 ), 

hence 

K+i| < \v n \ + \ 7 eM(t n )\((al)^\Al-Al\ + Al\(al)^-(a 2 n )^\). 
However this implies that 

K+il < \v n \ + M|e|(K| + \v n \), (8.27) 
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for some positive constant M. Let us define x n = maxj^o — ,n\ u j I an d y n = maxj^... n \ v j\ 
and z n = x n + y n . Inequalities (|8.26p and (|8.27|) hold also for k < n, i.e., 

< \u k \ + C\eu k \ +C\e\(x k +y k ) + Ce 2 , \v k+1 \ < \v k \ + M\e\(\u k \ + \v k \). 
By taking maximum over k G 0, ■ • ■ , n in these inequalities one obtains 

x n +i <x n + 2C\e\x n + C\e\y n + Ce 2 

and 

y n +\ <y n + M\e\(x n + y n ) 
By adding these inequalities, it follows that 

z n +i <z n + (2C + M)\e\z n + Me 2 . 

This in turn yields that z n < C\e\, for some positive constant still denoted (with some abuse 
of notations) C. Therefore 

> a n+i ~ \u n +i\ > a/2 - K\e\ > a/4 

for |e| small enough. This proves (|8.24[) . Moreover z n < C\e\, 
implies that 

\ a n ~ a n\ = \un\ < C\e\, Vn G 0, 1, • • • ,N. 

and 

\A 3 n -A 2 n \ = \v n \<C\e\, Vne0,l,--- ,N. 

□ 
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